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Introduction 

When we loo* it the silhouettes in Picasso's wor* "Kites of Spring" (figure I). "« 
perceive them in terms of very particular 3-D shapes, seme familiar, »m less so. This a 
quite remarkable, because the silhouettes could in theory have teen generated by an inf trite 
variety of shape* which, I torn other viewpoints, have no discernible similarities to the 
shapes we perceive, One can perhaps attribute part of the phenomenon to a familiarity 
with the depicted shapes; but not all of Lt. because one can use the medium of a silhouette 
[0 convey * new shape, and because even with considerate effort it it difficult to imagine 
the more biiarre three^im«nssonal turf aces that too Id have given rise to the tame 

silhouettes. 

Thit phenomenon is or quite general importance for the analysis of an imige. 
The boundary of a silhouette is simply one type of atfludifif contour (see e.g. Waltz 1975). 
and such contours are an artist's principal meant of conveying information about shape. 
The paradox is that they apparently tell uj more about thape than they should. For 
example, neighbouring points cm such a contour could in general arise from widely 
separated points on the original surf are. but our perceptual interpretation usually ignores 

this possibility- 

This means that Implicit in ch« way we interpret an occluding contour, there must 
He some b pnm-t assumptions that allow ui to infer a shape from an outline. If a surface 
violates these assumptions, our analysis wiJI be wrong, in the seme that the shape we assign 
to the contour* will differ from the shape that actually caused them, An everyday example 
of this uhenomenon is the shadowgraph, where the appr n pr]*te arrangement of ones hands 
can, to the surprise and delight of a child, produce the shadow of an apparently quite 
different shape, like a duck bi ft rabbiL 

What assumptions is it reasonable to suppose that we make? t shall argue far 
these two; (a) that nearby points on a contour correspond to nearby points on the viewed 
surface; and (b) that the distinction between convexities and concavities in a contour 
reflects real properties of tine surface, not an artifact of perspective. 

Some surfaces seen from some viewpoints will satisfy these conditions, and some 
will not. Our first tart it to understand what it is about a surface that makes it satisfy these 
assumptions, and the main result of the first part of the paper achieves this. Theorem 1 
shows that, if the assumptions (a) and (b) hold for all distant vanajje pints such that the 
tine Of Sight lies parallel to some fixed p^ane, then the viewed surface must be a gen*r*ltz*d 
cone. (A gf n* rained COne is the surface swept out by moving a cross-section of fixed shape 
but smoothly varying Site, along an axis, as illustrated in figure 5} 

This remit is strong and surprising. It means that if one has a method for 
interpreting contours that relies on assumptions (a) and (b>, then the method implicitly 
assumes that the viewed shape is a generakiied cone. One can think of such a method as 
first throwing a ^eneralneo cone blanket round the viewed shape, and then describing the 
shape of the blanket. This in turn means that the representation of 3-D shape that is 
subsequently used can. without Further low of information, be based on grnera Liied cones 
(lite that of Mart fr Nishihara IS'JTJ- 




1. "Rites of spring" by Pkasio. We immediately inTerpre: [he silhouette? in term* of 
particular 3-D Surfaces, despite the paud'.y nf information In che image, In order to do this, 
we mutt be brmgjng additional assumption i and conitramts to bear en the analysis of these 
contours' shapes This article en^uirei about the nature of thii a pTi&ti information. 



The result n of practical importance, because it an be used as a basis for methods 
that interpret occluding contours. This ii the point of the later sections of the article, where 
we shall assume that the Viewed, object is a generahMd tone, and asV how to discover Its 
specifications ^ItS axis and cross-section) using only the contours that are visible in Hi image. 
The second section deal* with the image Of a Single generalised cone, and the third, with 
objects that are competed of several cones joined together in vailOUS ways, These methods 
will be successful provided thai no aKIS appears severely foreshortened ]n the image. Vatan 
(L976) and Vatah & Mar? (]£77) exhibi: algorithms, based on the theory, and the results of 
applying them to a number of natural images, 

The main body of this article attempts to tec twit the motives and results of this 
research iti plain English. 1 hope that it ml\ be accessible to the general reader. The 
appendix contains- precise stare-menis of the restrictions and theorem*, and gives their proofs. 
Moil Of the arguments there are geometrical, and a specialized mathematical background is. 
not necessary to understand them. 

flotation 

As far as possible, I shall adhere to the following conventions. Surfaces, curves 
and fcmet in three-dimensional space will be denoted by upper-case Greek letters (£, Di 
curves and lines in an image from viewpoint V will be denoted by sufficed upper-case 
Roman letters (5p/, C y \ and upper-case Roman letters without a suffix [P, Q) denote 
points, either in 3-Space or in the image. Lower-case letters obey the usual conventions, so 
tkat/, g, i and p are functions, n , 6, $ and ^ are ah|1es and *, y t t are coordinates. 

1: Tlie basic KypatKcseis and their implications 

Our discussion will centre on the four structures that appear in figure % These are 
fl> some 3-D Surface Ii &} KS image or silhouette &y as seen from a viewpoint V\ (3) the 
bounding contour Cy of Sy; and (4) the Set of points on the surface J, that project onto 
the contour Cy. We shall call thiJ kst jet the conSttur gentraior of Cy, and we shall denote it 

by iy. 

We depress the assumptions, to which I referred in the introduction, as restrictinns 
on portions of the surface E or its image. 

Rciirictifrti Rl.-TA* atrfeet £ it smak. 

We maXt this restriction only because we need to be able to distinguish convex pieces of 
contour from concave ones, and it is easiest to do this if the surfaces and contours in 
question can be differentiated twice, (In Fact, we could have aliened the contours in the 
image to be composed or straight line segments, since the notions of convex and concave 
have a well-defined meaning in such cases; but little is gained by doing this). 

Remtctton Rl; Each ptinl an ike odtUcmt generator Fy projttts a a different poim on 










2. The three-dipwijionil surface £ h viewed from a point f, fgmw the iiJhouetce Sy in the- 
image j?i& [he imaging process i. The boundary of 5^, obtained by the boundary operator H 
ii dertoted by Cp and we call it the contour uf I. Th« jet of points on 2 that i naps onto 
Cy we call the contour generator of Cy> ind it ii d*no*ed by Tp. The map from 2 to Ty 
induced by 3 is denoceci by £ 



the amtoar Cy. 

This means that rich lint of sight From f to the edge of T - that is, from V to Ty -- 
couches £ at only one point, not at two pninES. (is shown in figure 30) or along a line 
segment. The condition that each, line of sight touches 2 at one, rather than at two or a 
finite number of points. Is equivalent to laying that E it converts seen from this viewpoint 
(see figure 70). This is not ai Jtrong a condition as it appears at first sight, because in 
practise It will not usually be imposed for all Viewpoint! (e.g. theorem I), and there are ways 
of regaining the general ixy that it escludes (theoTem 5}. Forbidding the line or sight from 
touching £ along a line segment {as can happen Tor example if one views a cube from a 
direction parallel with one of its. faces) is only a technical restriction;, one can escape it 
without changing the situation in an important way by deForming the viewed surface very 
slightly. 

fUsiztetton R3: Nt&bf ptintl on tht tmlwr Cy aits* from nearby puinil Ml tht centaur 
gnurater Ty* 

This condition is a powerful one, and is best explained by figure S. Suppose that the 
contou: sfr oF figure 3 really arose from two hitls r but tht dotted portion of * happened to be 
invisible. Then the contour generator of ah wpuld be discontinuous at P, where it leaps 
From one hill to the next. This is the situation that R3 Forbids, and it is essentially 
equivalent ro assuming that the linage cDnrains no invisible obscuring edges, Together, R2 
and RS imply that the contour generator Ty a a continuous curve across 2 - i.e. that it 
does not jump erratically from place to place on I. R3 is a strung condition, but without it 
one can say almost nothing about E and I know of no way to proceed Without It, 
Fortunately it is obeyed by most real-world images. 

RenjarJt 

In fact, R2 and R3 are not quite independent, since if one assumes that the 
surface 2 is bounded, R? is a consequent* of R2. To see thus, notice that at points like P in 
figure 3 where R? is violated, the viewing ray to P grain both hills, and so causes a 
violation of R2. Nevertheless, the two restriction* have suFfiriently different meanings to 
mike it worth stating them separately. 

Uiing poimi cflnjietien 
The restriCTicms RI-R3 are very general, and guarantee only the integrity of C v 

and Ty, not their InterpretabiSity. Let us therefore suppose tha? a contour Cy, lite chat 
shown in Figure 4, was obtained under conditions that satisfy these restrictions, and enquire 
what properties of Cy we can rely upon. Clearly, no metrical properties of Cy can be used, 
because Cy arises from viewing a surface £ at an unknown orientation - i.e. through at 
best a linear operator, and such operators do not preserve distances. The values of Cy s 
maxima and minima, and thtir wparailon, remain unmformative until substantially more is 
known about I and the perspective from which it is being viewed. But the qualitative 
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nations of maxima and minima on a plana? COive art preserved by a linear operator — that 
i*. the distinction between convex and concave is Invariant- This fait is captured by Lemma 

I of the: appendix. 

Let ui therefore suppose that we have been presented with a contour segment file 
that shown in figure 1 Restriction RS guarantees that adjacent points on the contour arise 
from adjacent points nn the surface I, but no metrical feature* arc yet reliable. The only 
it raigh [forward feature "ha' remains is the distinction between a convex contour segment 
and a concave rme, which rests in turn on the notion of an JnNeKfcon point. For a general 
surface I and contour generator Ty. even paints of inflexion in Cy will' often be 
meaning I esi, and to attribute significance to them is tn male an additional assumption about 
%. So we next ask, how exactly ihould we formulate the assumption that points, of inflexion 
are significant? 

The restrictions. Rl-RS allow us to think, of Ty, the contour generator of Cy on 33, 

II a smooth piece of wire bent tn 3-space. For inflexion paints on Cy to be significant 
however, lemma I (see the appendix;) rails us that we need two things; (1} the transformation 
due to the imaging process that produces Cy must be linear* and {£) the curve on which that 
transform acts must lie in a plane. Because the general perspective transformation is not 
linear, condition (I) tells ui that our whole theory applies only tc distant viewing points, 
because only in these conditions is the imaging - process, a linear projection. Condition (2) 
informs US (hat the ion vex -concave distinction can be meaningful in Cy only if the bent 
wire that is Ty lies in a plane. This gives ui our fourth condition. 

ftestrtcuan R4: The conlc/UJ generator Ty &f % H planar. 

This condition IS a Strong; one r and Sharply delimits the class of admissible surfaces £. There 
seems however to be no way oF avoiding it il" one wishes to use :he distinction between 
convex and concave contour segments. 



Implications of tlio four restrictions: 

A generalized cent, illustrated in figure E. is defined to be the surface swept out by 
moving a simple smooth cross-section along some axis, at the same time magnifying or 
contracting; it in a smoothly varying way. This cross-section is defined by the function 
j>(r, 9) m 0, and when the cross-section is convex, we shall use cylindrical coordinates r * 
fi{$). The magnification of the cross-seuion at each paint Is specified by the function h(z} t 
where z is the distance measured along the cone's a* is. The a it is itself will be labelled A- 
Netice that in general the z axis need not be perpendicular so trie plane % - Q of the cross- 
section. These conventions are illustrated by figure 5, 

Wc may demand that the restrictions R2 - R4 hold for all views, or for a subclass 
of the passible views of E- If we demand that they hold for only one {distant) viewpoint, 
this imposes no interesting restrictions on the nature of 2. Theorem I studies the two 
dimensional case, when the restrictions are assumed to hold for all distant viewpo-lnrs whose 




5. The definition of a generalized tone. In this article, i generalized cone is the surface- 
generated by moving 1 & smwth cioH-wfiLan p along a. itraight axis A. The crow-iK[ion may 
vary smoothly in sire (as prescribed by the axial scalini function tfz)), hut els, shape regains 
constant. The eccentricity of the nine ii the angle ^ between jk a:<ii arid a plan* containing 
a :r&5.&-s«JJon 



lines of sight lie parallel to some Fiscd plane,, and it is the mow interesting result at the 
uctLort. Finally, theorem 2 studiei the consequences of assuming thai the restrictions hold 
for ■i.'." distant viewpoinn. 

Earlier, we defined Sy to be the imigc of I as seen from the vantage point V 
(figure 2). This is equivalent to saving that % U the perspective projection of E from the 
point J-', |n theorem I. we shall make two simplifying assumptions about the projection Sy t 
first that the projection u orthogonal. Which is approximated when tine vantage paint V is 
very distant from £ compared to iti size, and second, that the viewing directions are 
confined to a plane II round £ and which intersect E. We deal in some sense only with 
"side" views of E, and are forbidding "end-on" views. Such projections are completely 
specified by the direction of the vantage point from £ In the confining plane II, and we 
denote this by thr angle ^. Wc shall use the notation S±, C^ and T& in place of Sy, Cy 
and Ty to indicate that thf above renriCCJOriiare in effect. The proofs of theorems 1 and 2 
are set out in the append ix.. 1 give here 2 heir starements in plain English. 

Theorem. I, 3 is a generalized cone with convex ■cross-section if and only if 
Rl IS Satisfied, and R2 - R4 are satisfied for all orthogonal projections (b 
associated with some plane IL In the sense defined above. This plane lies 
parallel to the CT055'sec2ion of the cone. 

Theorem 2. Z satlif its Rl and R2 - R4 far ail distant vantage points V it 
and only if E Is a quadratic surface. 



/TfflSrAs about tktortjns S and 2 

It is. theorem 1 that allows the crucial step for the overall argument. It says that if, 
for disiant viewpoints whose viewing directions lie parallel wj some plane, a surface's shape 
can successfully be inferred using only the convexities and concavities of its bounding 
contours in an image, then that surface is a generalised cone with convex cross-section, or is 
composed Of them. Hence if one nssu.miL that one can discover a surface's shape from such 
information, then this is equivalent to atsoming that Che viewed surface is a generaliued 
«me. The assumption of theorem 3, about orthogonal projections parallel ro the plane of 
the cross-section, is tolerable because as we shall see the methods to which the theory gives 
rise usually degrade only slowly as one moves, rvearerj increasing the effects of perspective or 
out of the plane qF the cros-5-seciton. Furthermore there dues appear *jq be something special 
about the perception of views that look down the S-astS of the figure (see the remarks made 
by Marr St Nishihara (19T?) about Warrington St Taylor's (197 J) 'unconventional views"), 

Theorem 2 is interesting, because it shows how very strong our restrtcnons are, 
One can gain a fee] for how the planar condition R4 fails for higher-order surfaces by 
studying the behaviour of s 2n * y 2 * * z 2n - I (see figure &}. This Surface is a sphere for n 
- U and tends to a cube as n grows large. The coniour generator Ty. which is a circle for n 



- J (figure 6*}, becomes the outline marked wiih thick Imei in Tig u re £b for high, values of 
n. This contour-generator is clearly net planar; as n increases, the lower third of the contour 
generator is pulled toward! the viewer, and the upper Ehird i= pushed away. 

These results provide a further argument for using something based on 
general iied cylinders {Bmford 197J) for the inamal representation of shape {see Marr k 
Nishihara 1577), an argument based not on utility* as most other justifications are, but on the 
assumptions implicit in the decoding of an image. It » indeed extremely fortunate that 
many important three-dimensional structures tan be closely approximated by a few 
generalized cones, ilthm^h j: Is not accidental that objects whose shape was achieved by 
growth like limhs and JTalasjm itrs. can he so approximated. 

2: Interpreting tho innate) of ft single gfiaaralised oone 

Theorem ] essentially tells us that, when trying to Infer the shape of a surface 
from itj bounding contours in an imnge we cannot avoid assuming that the surface IS a 
generaliied cone. We are now faced with an obvious question. If we assume that our data 
consists of contours in the image of a generaliied cone, how may we interpret them? To 
specify a generalized cone P we have to specify its axis &., cross-section jt(t). and axial scaling 
function h(t)\ how can we discover them from an image? 

The answer to this question commences wuh theorem 3. which shows how the 
occluding contours in an image may he used to find the ■"image"' of the cone's axis for those 
delta nt viewpoints that lie in Jhe privileged viewing plane referred to in then rem 1. In 
genera E, of course, cur viewpoint will not tie in this plane, and so we have to examine the 
stability of this result a.s the viewpoint moves, out of the plane. This ii achieved by theorem 
-i. Which Introduces a new concept called the sktitton of a generaliied cone. The skeleton il 
not a difficult idea, however, since it is very lii.e the- se: of lints a cartoonist draw? to convey 
the shape of a curved object. The idea of a skeleton allows us to extend rhe theory to 
generalized cones whose cross-Section is not convex. Requiring the restriction R2 lO hold for 
all ^-projection! essentially forbids this class of cones, and I said earlier that one can 
circumvent thu restriction in practise. Theorem 5 shows how. Finally, there is a short 
discussion abcuc cases in which the cone ts viewed from a nearby rather than from a distant 
point, and cases in which the axis of the cone is not a straight line. 

The Overall purpose of (he section is io give a set of methods for interpreting the 
image Of a Single general] led tone. The methods derived here will not succeed for all Views: 
they will fail when the image of the coneys asis il Substantially foreshortened. Jt is part of 
the overall theory that such views have to be handled differently (Marr k Nishihara \Vfi\ 

Finding the axiipvm. a fawn-ruble vi&t 
Provided that the viewed surface is a 2en*?A,lised cone, and that the viewing 1 point 
satisfies Che conditions of theorem 1. the axis of the cone may easily be determined by the 
fOUgh symmetry formed around Jt. 

TAcartin > f Axial Summary). Let E be a generaliied cone with convex cross- 
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section pf$h and k' the CfOSS-stcUon sciling function h(t) contain at least 

one concavity, TKrn Co: all viewing directions $ 

(i) the silhouette of £, C^. decomposes imo it > 2 contour segment! by 

splitting it at points of inflexion: 

00 the image of the axis A of E esiiblHhes an axi^L symmetry between at 

lean (n - 2} contour segments, including all concave ones. Corresponding 

segments arc either both convex ni both concave; 

(iii) the ratios of the distances of correspond in % segments either Side oF the 

axis of symm-eTry arc all the same;. 
Corollary.- The image of the axis of I is uniquely determined if there exists Only one such 
axiil symmetry. 

This theorem Ls best es plained by looking at figure 1. Here we ice that the 
contour divides at inflexion points into three segments, labelled C f to C$. The two concave 
teg ments Cj and Cj- are roughly symmetric about the image of the cone's axis A, although 
their distances away from the axis may not be cquaL The third clause of the theorem state* 
that, if £/ is half as far from A as C^, then the same will be true of all other segments that 
correspond under the symmetry. We shall all the type of symmetry established by theorem 
3 a ouaUtsiiVi lymmclTy. Its important features are {a) that It holds between convex or 
concave- stgm-eJtli of a contour, and (b) that it includes a seeing fac:o:. 

Although there Is a point-Wise symmetry between the contour on (he two sides of 
the axis, tin leu the viewed surface Is a right generalited cone and Che contours are 
faithfully diagnosed In the iffiage,. such symmetries ate expensive to detect- A. qualitative 
symmetry, on the other hand, does not have to be found on a point-by-point basis. This is 
important because it makes /in diuf the symmetry, and hence its axis e a practical 
computational proposition. By dividing the contour into conveK and concave segments and 
noticing thai ihe symmetry preserves this distinction, we have greatly reduced the number of 
items That have to be examined and made the computational load acceptable. 

There is one other point of importance about thu result and Lt comes from the 
corollary. ivriLch ssys :h" if only one symmetry exists among the contours, the axis of J ii 
determined uniquely. This means that the analysis of contour Ls self ^checking, and one does 
not have to appeal to the ""familiarity" of the deduced shape to know that one has a valid 
interpretation of the image. This is of course essential if on* is to be able re analyte novel 
shapes. The reader will observe that all of the theorems, that are directed at the analysis of 
contour, have uniqueness corollaries like that of theorem 3 E: is on these that the algorithms 
themselves will rest most directly. 

VltWiTig direc lions not copianar wita a amt's apjfftCtUm 
We next ask what happens to the generalized cones of theorem 3 if the viewpoint 
remains distant, but if she viewing direction moves out of its constraining plane 11? M ]qr% 
as Che image Sy approximates an orthogonal projection parallel to the plane of the 
generalised cone'i truss-section, variations in the sjlhouerte of E are due to changes in the 
scaling function hit) along the cone's axis L, as illustrated by figure Sa. On the other hand. 
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when the viewpoint is moved so drastically that the viewing direction lies parallel to A» the 
silhouette of S is due entirely to pffl), its cross-section f uncLLon (fig u re &b), and is in fate due 
to the Cross-section of E at The point inhere ft(l) achieves its maximum value. 

At both of their extremes the contour generator Tl/ of 2 is planar, but for other 
Viewing direction it need nc J . be. This js obviously true for a dumbell shaoe, or for an ice- 
cream tone, but theorem 2 assures is that it is more insidiously trj; even for a surface as- 
simple sj an egg. where the contour generator ii a circle for the end -view. a. near oval far a 
sLde view, and ilidei from one to the other in between (sh figure IQb below). Another 
example is the surface Shown in figure 6c; the contour generator from this view is clearly 
not planar. 

How are we to handle such views? For convex objects Like an egg, where the only 
occluding contours arise from its silhQUfTTt; there is- very tittle more one can do ro infer IU 
shape when seen from one of the intermediate views, unless one knows something about the 
orientation of the egg relative to the viewer. For object! that are not convex, like the double 
spixe of figure S, one can separate the contours that arise in the image into two class**; 
those approximately due to the "sides" of the figure (the two spikes separated in figure &d), 
and those approximately due to a cross-section, like the central ellipse Ln figure Bd. 

This division gives us our main tool for analysing non -standard views, and it is 
best explained wicb the help of figure 9. Suppose that a genera I Lied cone J is being viewed 
from a distant point V and the tine of sight Is not parallel to the plane of the cone's cross- 
section. The contour generator for vjewpoin: V is approximated by two components- One 
is easy to define-, it is the places on £ where the size of the cross-secnon is stationary - that 
is. where h[i) achieves a maximum or minimum. For an egg. it is the fattest cross-section, 
and other examples are shown shaded in figure Bl We call these curves reHiai exttntiitiei. 
and denote them by T — natter there is no suffix, unce T does not depend on the vantage 
point, The other idea we have ro ma*e as precise as possible is what we mean by the "sides" 
of I from a Viewpoint such at V, and for this we make the conic ruction illustrated in figure 
9. We drop a perpendicular from V to W, whLCh does lie in the standard viewing plane. 
Then the contour generator for viewpoint V IS approximately the projection of the contour 
generator Tyi for V\ which is simply I"a for some angle $. For example, in the case of an 
egg of length i and diameter d. the sieleton (shown in figure 10b) has length l-ftr\(x) *nd 
width £, when viewed in a plane containing the egg*s major axis at an angle x to '*■ F*w 
angles where Ijintx) * d. this is a reasonable approximation, and when t.si7i(x) < A, we 
hive an "unrjohventianar view. 

The reason why the skeleton is a useful construct for recognition is. that one can 
detect its presence in an image by the many relationships that exist among its parts. In fact, 
we can use these relationships to set up constraints on a set of occluding contours such that 
if those constraints are all satisfied by a unique interpretation of the contours, in the image, 
we can be reasonably certain that we have found a skeleion, and hence can interpret the 
contours as arising from a genera 1 1 ted tone E whose axis is then determined. The relations 
themselves consist of qualitative symmetries and parallelism, and are preserved by an 
orthogonal projection, Hence provided that the contours at seen from vantage point V in 
figure 9 are approximately the projection of the contour* u seen from vK the relations wilt 
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10. Examples of skdecom of surfM« h as defined, in [he Test and in figures 3 and 9. The 
cross-sections responsible for the radlil eKtremJtks of fhc surfaces are shown shaded. The 
skeleton ceases to e* a reaso-nibk aeproxjmatjGn to [he concurs [hat occur in the image 
when Ever the viewing angle is such as to make the projection of the length of :he cane leis 
than she orthogonal projection of its width. For suth vitws r the methods of [his article will 
fail. 



s.ill hold m the image formed; from V. 



TAeorm 1 (Skeitw Tzecrtm). Let Tyl u T be the skeleton of E aswdaied 
with lome Vantage peine V. Then provided Chat Cp can be thought of as 
being formed by the orthogonal projection of TV along the direction to 
the vantage point P, 

(i) t^ is qualitatively symmetric about the image of the axis A of E> in the 
sense of theorem S 

(li) the image of f consists of one or more connected components, through 
which A passes, and between any two of which there exists a mapping that 
i* (1 - t), continuous and onto, that preserves toe gradient of the image of T 
at each point. 
Corollary: If 2 obeys thr prerequisite* of theorem i, and if the image of LIS skeleton 
dEcompowi in a unique way into two components that satisfy conditions (l) and (ii) of the 
theorem, then these components are the image* of Ty and of T- The axis of symmetry of 
the image oF Ty is the image of the axis of I. 

ThJi theorem make* explicit the many relations between the elements of a 
skeleton's image, and its practical importance is illustrated by figure 11. The theorem states 
that the image of the "iides" obey* quite welt the symmetry relation of theorem 3, and one 
can see rrom the figure that this is true of the sides of the bucket in the image. The axis of 
Symmetry of the sides Is the axis of the bucket. The theorem also says thar the images of a 
Cone's radial extremities are all parallel to one another and embrace the cone's axis. Irt 
figure ll, there is a clear parallel relationship between the image of the bucket's top. the 
corrugations in it? side, and the visible part of its base. 

Aj in the case of theorem 3. the diagnostic power of this result liei in the corollary. 
It does not guarantee that a given set of occluding contours can be interpreted, but if a 
unique interpretation esiin that satisfies these conditions, then it will be correct. In a real 
image many parts of a cone's skeleton wilt be obscured, Out this hampers the finding of 
relationships like parallelism and qualitative symmetry only slightly. One -can devise a 
cooperative algorithm (Marr & Poggjo 1376) that can Operate on the description of a contour 
to find relationships of this kind between its pieces (Vatan & Marr 1977). 

GciunttHtd cones whast trtii-ttC(io7i is irof convex 
We are now ready to extend the Theory to the case where the cone's crcus-iection 
contains concavities. The important difference between this and the case where the cross- 
section is convex is that occluding contours can now also arise from local maxima and 
minima in the cross-itction p. For example, in che image of a fluted pj||ar h there are many 
lines running parallel to the axis of the pillar, corresponding to the local maxima or minima 
in the pillar'* CTttu-section . 

This gives us the extra toot we need to extend the analysis of theorem 4. 
Contours that ate due to convexities and concavities in the cross-section p behave like the 
fluting on a pillar, so we call them the tone's /furtnf *nd denote them by the letter *. The 
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f luring on a cone with variable crosi-scction behaves rather like the silhouette of rheoren 3 
Convrxr.LEi and con cavities in the Nuting on one side of the cone's axis are in qualitative 
jyrrnTietry with (he fluting on the other side :>e. seen by the viewer}- This means thftt 
contours jn the fluting obey a set of qualitative jymmeiry and rough parallel relation* 
among; rhemselves, similar but orthogonal to those obeyed by the radial extremities. These 
relaii oriilii pi can be u*ed to interpret the con ton n in an image, In a way analogous to 
theorem i. The ex tension or Theorem 4 to the taw of a cone with fluting is th«rem 5. 

Thtt/rm 5. Let Tyf u T u * be the skeleton and f luung of E associated, with 
some distant vantage point V. Then 
(i) Cy and T obey theorem 4. 

(Li) The image of each portion jfAW.pf JjJ, J r a), for fixed t and varying 
z} of the fluting is either a straight line, or it divides into convex and 
concave segments that are in ii - 1) correspondence with the convexstie* and 
rcncavities in that part or the imagfl of Yy which lies on the same iide of 
its axis of symmetry. 
CQritH&rj; If r is a generalized cone, and if :he contour* m ITS image decompose in a unique 
way jntg three pairs that satisfy (he conditions of theorem 6, then those parts are (i) the 
image of Ty, whose axis of symmetry is the image of the axis of Z; (a) the image of T. the 
radial extremities of I; and (Hi) the image of *, the cone's fluting" 

Once again Thii result enables Us to set up a system of constraints on the contour 
present Ln an image iUCh that, if the Constraints are satisfied by a particular labelling of the 
contour, that labelling enables us to discover the axis A of S h and other information about 

its cross*sectiofi p and axial staling function ft. The algorithms that implement this method 
heed only recognise the properties or parallelism and qualitative symmetry between a iraall 
number of elements. This result reaches *ligh"ly beyond the scope of this article since it 
deal* with contour chat is not necessarily occluding. It also extends naturally to the case 
where p contains creases (points of discontinuity m giadien:! 1 . which is helpful because 
creases often gave rise to edges and highlights in an image 

Ntsxty vittving point f end tweed sxu 

The methods discussed in this article are ill-suited lo images that arise from 
nearby Viewing points, and are of Little use for cones witli curved ax?* '.mips* their CTOSS- 
sections are simple, These points ate best made by figure 13, which shows a serpent weaving 
towards and away from a nearby viewer (figure 13a), who sees an image that resembles 
figure 33b. The pomes Of inflexion m figure 13b are caused by perspective, and to recognise 
this one needs other cues, like texture gradients and stereopJIS. 

If one sees the contour :hat appear* in figure 13c, one can and does infer the shape 
■of a inake. Cimi sugh n* figures 13c St d, whprt the scaling function ft is roughly constant 
are easy to deal with; to aie other cases whet* the qualitative symmetry of theorrm 3 is 
reveried [it- convex segments maich concave segments, not convex ones), but in general Lhe 
situation can be complex. I have been unable to derive any substantial result! from 
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13- The methods, of this article ai< based on the distinction between ccmvex and concave 
COTTCQur segment They are therefore unsuitable for icnagei of nearby objects-. For 
example-,, if a viewer is close to a snai.* (aj in 13a}, the image he sees will be icmetrung like 
Ub. The conveKiliej and concavities in this are mostly due to the perspective 
transformation, and they do not reflect prCperues of the viewed surface. The figure* in 33t 
and d ate generalitec, cones with curved ases. It is not known how 10 deal with these except 
in simple cases Lixc those acpatied here- 



circumstances in which the surface I and its viewing point are unconstrained. 

3! Surfaces composed of two or more generalized nones 

We have hitherto been concerned wish the appearance of a single generaliicd 
COTIt Real-life abject aie often approximately composed of several different tones, joined 
together in various, ways (see Man k Nishihara LS77 figure &), an d we therefore have to 
study way* of decomposing a multiple cone into jti component* - for example, a human 
body into arms, legs, torso and head. The way in which two cones join hai a profound but 
usually local effect on the contemn produced by the resulting surface, and it car upset the 
qualitative symmetry and parallelism on which our earlier results depended by interfering 
with che inflexion points, on which primary contour description is based. Therefore, The 
algorithms for interpreting occluding contours in an image must incorporate a sensitivity to 
situations that Can arise as. a resuh of joins. 

In this section, we study the common types of Cone-cone junction, classify the 
appearances ta which they can give rise, and indicate hoi* algorithm*, for their detection 
may be constructed. In order to do this* we once again have to place some restrict inn on the 
way in which a join Ls configured. The one that I eh nose is: 

Restriction 5.- Tht QXtS of iim> jmntd gtntraiittd Mu or* toplaner, 

which enables one to relate the silhouette uf the junction between TWO cones to the angle 
betwetn their axes and their axial scaling functions. If the two axes, are not coplanar, the 
surfaces a.! the junction are rather unconstrained- In practise. R$ is. not a severe restriction. 
Provided that the two axes approach one another dosety relative to the width of their 
respective cones,, the coplanar condition will be satisfied closely enough. 

ArSidr-to-end jb(ns fiiftum fm gtAtraiiztd conti 
The most useful common feature of the join between two cones is that it gives rise 
to cue or -wo deep concavities in the surface's silhouette This feature is unfortunately not a 
necessary concomitant of a cone-cone junction, and although it plays a large part in our 
algorithms For detecting such a junction (Vatan igfa), its. role in Ehe underlying theory is 
s,uxp! isingly slight. 

It is convenient to divide the types of join that can occur into two classes, those in 
Which the end of One cone II attached to the side of the Other, and those in which the two 
cones are attached at their ends. The two types, of join are illustrated in figure H, and a 
formal statement of the distinction between them is given in the appendix. These two tas.es 
are not quite exhaustive, but the intermediate caws introduce no new points of interest 

From the point of view of diagnosing these joins, the important difference 
between them ts that there ate often two concavities associated with a side^end jotn. (one on 
each side of A^ as shown in figure Lia}, but there nerd not be for end*to-end joini (figure 
14b). We analyze the possible configurations, case by case, 
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Al: Bath contt art amvtx 

An important due for joins between cones is. the existence of deep concavities in 
the bounding contour. Figure Ma Illustrates ehli- Provided thai thr end of one core joins 
the side pf the other well between iu ends, one cannot help forming substantial concavities 
In the outline. The precise result that establishej this for convex cones is theorem 6, but the 
details may be confined to the appendix without loss, It basically states that the total 
concavity created by a join lite that shown in figure Hi 11 nearly 2*0* and this gives us a 
method for detecting such joins. Since an g lei of JJQ*' art preserved by Linear 
transformations, the effect of altering the viewing angl-e ls ennrely due to change* in the 
angles ^ thai are caused by foreshortening ^ or J 2 of figure 23l This means that the join 
will remain detectable until the projection of one cone's length becomes comparable with the 
projection of its width- (when (he view becomes "'un conventions Hi, or until the junction is 
obscured. 
A2: Conti net tifftJJithFTt rtmvex 

If the genera I i icd cones £j and Ej are not convex - for example, if their axial 
scaling functions con tarn concave segments - the concavities chat "ought* to arise at their 
junction can be concealed, appearing as part of the concavities due to their axial scaling 
functions. The simplest case of this is shown in figure 35, where, there is no identifiable 
Kmcavity due to Che join. Therefore, although concavities, provide our algorithms with 
useful first places to look for joins, we need somewhat more solid results, on which to base 
the underlying theory of join detection. 

The approach we tale for diagnosing joins IS similar to that of theorems 3 to 6. 
We establish a set of constraints that are satisfied by the different types of join, and argue? 
that, if the contours in an image decompose into segments tha! satisfy these constraints, then 
they may be interpreted as two joined generalised cones, if ihere is only one decomposition 
of the contours that satisfies these constraints, then the Interpretation is also unique. The 
relations involved are usually quite sample. We shall assume that /?? holds throughout this 
section. 

Suppose that an end of Ej joins the Side Of 2|. and that the resulting surface is 
viewed along the direction perpendicular to the planes of the axes. If the angle « (figure 
14) between their axes is small, or if the line of sight lies too near the plane of the axes, only 
one "side" of each cone ma,y be visible {fjjure 16). In such cas*s, there are no symmetry 
relations in the image, and the cones' axes cannot he found. 

Provided that both, sides of the cones remain visible (figure tT), convex and 
concave segments that lie dis:al to the join are uninfluenced by it and will obey the 
symmetry theorem 3. In this way, The distal segments of the cones determine their axes, 
which can then be extended bacx to the join (shown dotted in figure 17), 

This diagnostic technique jeties on the existence of segments distal to the junction, 
so we now deal with the case in which there are none. If we assume that the join tali.es 
place entirely within one segment of Sphere are sin possible situations and they appear in 
the top and bottom rowj of figure IS. Four arise when Ej and E^ consist of just one segment 
each, and it may be either convex or concave; the Other two arise because I*? can - straddle a 
Srgment boundary in E^ (column $ of figure 18}, It Is convenient to subdivide the cases 




15. Joins between car* can easily b* hidden. Ftere h concavities chat T, ougIit H to arise as a 
result of the junctigri are hidden in concavities that are caused oy the a^ial scaling function. 
This is why itrii^htforwarcl method* for finding jctm between cen« fail in the general. 
Cajfi. 
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11 If two joined cones are both ]nzig, which, means that they Both coniain more then one 
Moment, distal so the join, their am can be reentered by methods based on thcoyem 3 thai 
take no a«OUnL of the join. The axis fragmenu thus obtained, shown SfrlJd, can then be 
emended to their intersection point along the do«*d lines, and the join itidf can be analyzed 

after ch ts. 



where Z^ lj concave into those caiej in ivhich the value or h^ passes through a minimum 
and then increases a* one mtmi (Liiully frnni I] (bottom row), and thoif jn which [he 
minimum value of ^ is achieved at the distal end of A] (middle row), ]n Figure IB. this 
minimum value tf Mro. which produces a cusp-like I^- Notice thai case JSa exhibits the 
situation described by theorem 6, whjth guarantees the presence of the concave segment* 
joining Ej and E^. For reasonable values or /j and w:, 

We are new ready for the main result about iide-ra-cnd joins. Figure IB m plains 
what Is happening. ]n each of the cases shown (here, segmentation points P and £J can be 
found that decompose the contour to aj (0 Satisfy a number of relationships. Theorem 7 
defines the segmentation points precisely by making these relaiiOnsriips explicit. 

TAtorern 7 (Stdt-to'tnd joint}. Lrn ty be a connected contour bounding the 
image of two generalized cones Z\ and E^ connected by a side-to-end join. 
We assume that the image is farmed from a distant viewpoint chosen such 
that the viewing' direction lies perpendicular to the plane containing the two 
cones" axes A] and Aj. Assume that Cy is broken into segments at points of 
inflexion. Then there exist n*-o points P and Q each of which is either a 
point of inflexion or lies within a concave contour segment such that 
(i) The line FQ lies within the figure bounded by Cy 
dO PQ divides Cy iniD two paits Cj and C^ r between the conseur segments 
or fragments in each of which there exists a qualitative symmetry whose 
two ax.es are the imager of A] and A 2 

(iii) P and Q minimise the length of contour fy^-icn; left unmatched ty 

these symmetries 

Ov) contour fragments in Cj left unmatched by the symmetry round Aj 

would be ma-ched hy contours whose proximat parts, and possibly all of 

which, lie in the interior of Cj u PQ and via vrria. 

(v) the image OF A2 intersect* PQ between P and Q 
Corelfary; If the points P and £ are unique, these constraints determine a unique 
decomposition of Cy from which images of the two axes A ( may be recovered. 

In practise, it does not matter if P and Q are not unique provided that all paiUbfce choices' 
give the same axes. 

B.-Taie geatrnliZid cm jj joined tnrf-te-tnH 
If E] or E-2 contains more than one convex Or con^ve segment, rhat cone's axis 
may be found for segments distal to the join, just as they were found In figure J7 far side- 
Co-end joins. Hvnzt: we freed ■consider tinly the cur where Eg and Ej have ju?f one sejrneni. 
Once again, the main result depends on characterising the segmentation points P and Q, 
and figure IS gives examples Of segmentation points for end-to-end joins between the 
various types of single segment tone. Theorem & defines these points precisely; it is very 
Similar to theorem 1. 












16. If the jDined tcnes are ibon. the method of figure 17 cannot be used. This figure 
illustrates the [}p« at .side-to-end join that can ctzat. En the f jrs.t column, the left-hand 
cane is convex;, in the centre column it ii concave, and in Ehs EhiTd column, it U convex on 
one iide of ihe join, and concave on ihe other. The other cone is convex in the topi raw, 
and MBcive in the other wo, SegmEnLaticTi dflpe-ndj upon fardLn^ the points P and £ F 
which are defined in the t«tt by theorem 1 and liiutirated here for each case. 



Thtvrtwt & (End-lt**nd joint). Let C y be t connected contour bounding the 
image oF two generalized «m« £] and Ij connected by mi end-to-end join, 
We assume that the image ji formal from i distant viewpoint chosen such 
that the viewing direction lies perpendicular to the plane containing the 
axes or the two conei A] and Aj. Assume that C^ it broken into Wgments 
« point* of inflexion- Then there exist two points P tnd Q in Gp such 
that 

(i) Either mar he a point of inflexion, one (but only one} may he within a 
concave segment, and one (but Only one) may tie within a convex segment. 
(II) The line PQ he* within the Figure bounded by Ca 

(iii) P{? divjd« Cy into two parti Cj and C^ between the contour Segments 
or fragments in ea*h of which there e*iit£ a qualitative symmetry whose 
two axes are the image* of &[ and Ao 

(lv) P and Q minimise the length of contour fragment left unmatched by 

these symmetries 

(v) contour fragments in C; lefi unmatched by [he symmetry round Ai 
would be matched by a contour whose proximal parts at lean lie In the 
interior of C^ u PQ\ and vice vtria, 

(vi) the image* oF Aj and A5 interject PQ between P and £J 

Coroliarj.- If the points /> and £ are unique, these constraint* determine a unique 
decomposition of C v from which images of the two axes Aj may he recovered. 

^ £*lifljiim fa mm uteri im* wrotem- itpntnli art jtratght tinei 
The assumptions Rl - R4 that were made about Ig and 1% excluded cases where 
these surfaces contained straight lines. Such eases are frequent in real life; however, and 
some example* are shown in figure* l&e and f. I9e is a limit of I9d, and in some sense also of 
15a; l&f is a limit of all of the cases. 19f may be solved in the standard way; £ is the only 
concave point in she contour, and it matches eLther the point P, or it induces two "nearest" 
poinu P| and P ? that separate the two arms of the figure from the rectangte f^PjPPj. Both 
segmentations are permissible. 

Case I9e is more difficult. The only true inflexion points are Qj and fV but the 
line 0^2 lies outside the figure. If Q] and Q% are used despite this, the segmentation to 
which they lead corresponds to thinking of the figure as a rectangle with a piece excised <cf 
Hollerbach 1975 p. 55). Ttaii would be the preferred descrlptinn if £ L and Q 2 lie near P f . 
Since J9e may be regarded as the limit of LSd the point P (a corner joining two staight lines) 
can be regarded as a segmentation point, like the point P in I9d. P rhen induces the point 
£J as shown, which segment* the figure in Ihe same way a* [3d. When designing algorithms 
for dealing with eases where some lines are nearly straight, 'convex" Corners often acquire a 
dual status that arises from regarding the Straight lines as limits of concave rather than 
convex contour segments. This means m praaLse that straight lines are somewhat more 
difficult to deal with than curves since, in the initial state of the algorithms for 
implementing the methods defined here, Straight lines and the corners to which they lead 
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19. ]£a to d exhibits the possible r.ypei -o: findl-to-eno 1 Joins, for cones that contain only one 
seamen:. The HgmejitaLian poLnis F and £ are defmeci by theorem S, and iLLu.stra:ed here 
for (he differed-, casrt. They provide the basis for interpreting the pin irafft an, image- I9e 
& f exhibit the eortf t^Lirations [hit arise sn limiting ca«s where some or all of the coruwrs 
become straight lines. Notice that in Of, the symmetry relation* have degenerated into 



may be associated with several possible labelling!, 

C: Joins bttwern mart Tact; ttVG gftlxraliitd cants 
The principal difference between this and case fl nbove ii that a given point of 
segmentation tti*f have more than one match elsewhere. F<w example, in rhe silhouette of 
an octopus, the deep concavity between each tentacle matches two others. Also in this case, it 
is possible to have end-to-end joins in which both f and Q lie wj thin concave contour 
segments. The only straightforward result about the case of multiple joins holds when all 
the joined axei arc cnplanar, which is a common but restrictive condition. In this caw, the 
retevant result is so similar to theorems 1 and G that ] omit tL 



41 Discussion 

The purpose of this article was to elucidate the assumptions that can reasonably be 
made when interpreting the occluding contours in an Image. The assumptions at which we 
arrived were stated as restrictions Ri ■ n*, and it was then proved that these reitrimotii 
have a close relationship to the assumption that the viewed surface is composed of 
generallied cones. In the second and third parts or the article, we toot this result as an 
assumption and studied properties of imager of surfaces constructed in this way. We found 
that many constraints hold among portions of the contours in images of such surfaces, and 
thai rough symmetries are formed around the image 0^ the cones' axes. The importance of 
these relations is thai one can use them to design algorithms for finding the generalized 
cone-based description of a contour, and for extracting any axes that may be present. By 
applying these algorithms rcpsatedly to the contours found in an image, one can often 
derive the 3-D model representation (Marr Sc Nishihara 3977) or a surfaces shape without 
prior knowledge of it. Method based on the present theory wilt however fail for views in 
which one or more axes are foreshortened (rpoghly, whenever Che condition IjIji(x) * <* of 
page 17 is violated}. 

The theory presented in this article is a pure conference theory, or a theory at the 
topmost of Marr & Peggie's (1976) four levels. It is concerned with ends not means. The 
natural division between means and ends Is interestingly illustrated by the methods for 
segmenting a contour into two componenr generalized cones ^theorems 7 & 8). The starting^ 
point for our algorithms that actually find the points p ind G as defined by these theorems 
is the examination of deep concavities in the contour Cy free Vaah I97&), This eon traits 
strongly with the theory, because the concavities may be small or even absent, especially for 
end-to-encS joins. On If in certain circumstances does the underlying theory guarantee their 
presence theorem &). 
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Suppose that I is an arbitrary three-dimensional surface, and that Sy is its image 
from viewpoint V as produced by the projection iy. E —> Sy (figure 2 in the main text), 
S y has a bounding contour C y s&jr, (hat correspond* to the silhouette D f E F and which we 
an think of « Having been obtained by acting on fy with a boundary operator 3 (set 
figure 2), 

Definition. Let Tp be the set gf points on E whose image tie* on Cy. 

Then T^ is called thr toTifocir ^neT-QJor of Cy on Z. 
That is, I> k the set of prints P on I such that ip(^ lis en Cp. We can now define the 
operator «- 4fEJ - IV which ii induced bjr ^ and which selects Ty out of E- This U 
illustrated in figure 2 r where d is defined is such a way that the diagram in figure 2 
commutes - i.e. i v d - h v . Notice that t^, Cy, Sy and jy all depend upon the vantage 
point V. 

A formal Kitcment of rhe restrictioni R\-R5\s. now given; 

ReitrtellBTt Rl: I ij twrytihert Wtet dtfftttlMabtt Kith aittlTuuats ««mrf rfcriuaffiw. 
flwfrirfron H2-T.\f invent ty~* ; Cy — > Ty ts our- vsiut4. 
RisiTietim RS.-Tkt mapping iy .- Yy — * Cy if cmtHHicnii. 
Reilrictum R4:Tke opnlPtir generator Ty if Cy is planar. 
RiStnttlon ft?. Tht Axes oftm pitied generaiittd Cones are ceplanar. 

Lemma L L« fix, y) - describe a planar curve that is twice differentiate 



with continuous second derivative. Let L .■ f& — > R? b* a noo-singular 
linear transform gr the plant Then L preserves, points of inf kKlon in/. 
Pr«,/r We define j - L/ ( [he ,mage of/noder L t by tf,, f)-J(L^z r •}}}. Since L li linear 
non-singular, and therefore continuous, it induces a fj - |) correspondence between the 
slope* of tangents to/ and tangents (0 f. We can represent the set oF possible slopes py the 
unit circle s\ and so L induces a map I' r - S ] — > s\ winch is {I ■ /) and onto Hence L* is 
monotofiic (either increasing or decreasing) - that is, if 5 3 lies between J] and % *nd 
0| - f 2 l * £ t, then *■%) '■« between L'Vty and L^i Now a point df inflexion y cwi/ 
is a stationary print for the slope of the tangents to/ Because L* is monotonia L(X) Is 
therefore a stationary point for the slope of the tangent! to Lf- $. Hence L(X) is an 
inflexion point on g. 

I fiavr used a geometric rather than an analytic argument because it is clear bow 
the same argument applies to ttie case where/ js pietewise linear. In this situation, the 
analog of an inflexion point it a point where the ugn of the charge in gradient reveries, 
and the argument used here still applies, 

Definition. Let pfr r ») - Q be a simple dosed plinar curve that is twice 
continuously dlfferentiable; and let h be a twice continuously dlfferentiable 
positive real function. Let A be a line a! some angle + to the plan? of p> 
and denote positions along A iff the variable z. Let £ be the surface Aip. 
Then £ is a gattrattitd cent with axis A, erou-mttm fi, tailing function A. 



and ecantrmty £ IF ^ - T /2, £ will be called a right gtntrdtitd anf. {See 
figure 5 in The main tent). 

Dr/mlttm. Let f be i diitant vintage point for ike genera liied tone Z 
such thai (J) the image formed from ^ is in orthogonal projection, and (ii) 
the rays Jn the prgjection alt lie parallel ;o the pline of the crest-section of 
J. Let the direction of these ray* in the plane be denoted by the angle £. 
When these restrictions are jn effect, we shall denote the contour generator 



Thtortwi. I Let % t* a generalized cone with convex trass-section r - pfPJ. 
Then 2 satisfies rtJ everywhere, and for all orthogonal projections parallel 
to the trass-section p, it satis'' in the conditions K2 - R4. Conversely if Ri 
is satisfied by the dosed surface 2 r and if A2 ■ JH are satisfied for all 
orthogonal projections parallel to some plane n, then S is a feneraliied 
cone with convex generating crowiection p that lin parallel to H. 
Prw/i-Otir definition of a generated cane ensures that it satisfies RL Since e is generated 
by moving p along the axis A {*« figure 5), a given radial FO - (ptfl 8) sweeps out a 
plane that contains A, as p itself is moved akmg A. As £ moves, the radial PC maintains it* 
direction, hut shrinks or expands in a manner dictated by the staling function A(t). As C 
moves, it traces out a curve cm E, which we shall call Ty r and which lies in the plane A. 



Furthermore, the tangent mlitC trut Ides in the plane of p u the tangent cf to p at C F 
for all position* of G. Suppose thai we reprnen; the direction of cf in the plane of p by 4. 
If one views E from * great distance in the direction +, the line GV Is a line of sight to the 
edge of the surface E. Therefore G lira on the contour generator for this view of E^ But this 
is true ror all positions of PC at P move! along A, and so Vy is a contour generator. In 
fact it is r^. Furthermore, since p is convey the Umc will be true for every angfc 4 and 
corresponding pom: G an p, provided that the viewing direction! he parallel to the plane gf 
p, Hence E satiiFJes fl2 - iM for all $ uc h rjrthogonal projection!. 

The proof of the convene remfc it longer, and we rini need 10 establish three 
lemmas. 

Lmmn 2. S rt n' is convex for all planet n' parallel to the plane U of the 
given viewing direction!. 

Proof: Suppose that Intf were not convex. Then there would exist a line in n' that was 
tangential to E n itf at two points C t and G 2 say, as shown in figure 20. But the line Ofo 
is the ray that produces the edge of the image of j from this viewing angle, and G X G Z 
therefore projects to a point P say, on C>. &d ip-lff) would contain both &j and Gj, and 
40 would not he single-valued. This contradict! R2, 

■ 

Lemma J. If two distinct contour generator on E intersect at a point X. 
then contour generators for all distant viewing directions in the plane II 
pats through Jf, 
Prwf.-Tb* tangent plane to E at X, which exiits hy R! f contains two distinct vectors that he 




30. Lemma 2 show* tiQw restriction R2 forces p Co t>e convex.' 



in a plane para I Id to H- Hen« [tie tangent plane at X must itself be parallel to IL 
Lmjno 4. Let IV and F^ be contour generators far two different 
viewing direction* in II. Then T± and T* intersect on I. 

Pmf. Since £ la a rioicd surFac*, The T^ for any ingle 4 divides E into two components. 

This follow from the fact that if I is the surf a« defined by the equation yfo >> a) - ft the 

points on T^ are solutions to the equations- 

A J- =J - f2j 

where V is a distant vantage point along the raps of the orthogonal projection TV and the 
two components CDrreipOnd to points where equation <I) take* values » and < respectively. 
Hence r^ ahd F^ each divide I into in* connected components. Let II' be any plane 
parallel to II that intersects E in more than a point. 2 n II' is a simple rinsed conves curve, 
which meets T^ in G i and C ftl and which meets T^ in fl^ and G^, as illustrated in figure 
2L The tangents to E at Cj and C 3 are parallel, and so are the tangents at G% and G4. 
Clearly, the line CjCj divides the sjmpk: closed curve £ n n / into two parti, in one of which 
hei C 2 , and in the other of which lies c t . But G 2 and C 4 both Ike on F^ , whereas Gj and 
C 3 both lie on T^. Hence T 1 ^ and 1^ must intersect somewhere on E. 

CDrof^Tjp.- J^ and f^ intersect twice or more. 

We tan now complete the proof of theorem L Let TV and F^ be two contour 
generators for E far different viewing direction! tying in II. Since IV and Fa ? are both 
planar [by R4\ their containing pUnei intersect j* a line A (say^ By lemma 4 h TV and 




21. Lemma 4 established thai contour generators for two different viewing angles must 
intersect. 
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T^ , intersect m at lw.it two points,, and these points mutt theief ore lie along the line A. L« 
/V be a boundary poLnt of the wt of intersection pomu of V$ and 1^ on A, and let S be 
the next closest such point to N. Thij situation ii depicted in figure 22- &y lemma 2, all 
COMOUr/ generators pass through N and 3, which we may therefore think of as north and 
south poles of 2, and therefore the planes of all countcmr generator For views of I from II 
most contain if and & and hence the line A- That is> the planes of all contour generators for 
distant views from the plane II will intersect in i. 

Let TL f be a plane parallel to II lying between N and S r distant z from N. as 
ihewn in figure 22a, Let n' interject A at //, T 1 . at G [t and IN at C a . The 
configuration in If/ ii shown in figure 22b. The crucial step in the proof ii to notice that 
Up to scalar magnification, the geometry of figure 22b is independent of Z Y the position of 
II' along the line /VS. This follows from the following observation!: 
W The angle between HG, and HG Z « independent of e, because it is. limply the angle 
between the planes of F^ and fy measured parallel to IL 

(il) The direction of the tangent to p at 6 t is independent of i, because as i increases, G i 
traces out the contour generator T^ Jh which is by definition the Locus nf tangents to E 
parallel to H for a given fixed viewing direction dir. 

We deduce that for each angle $ in figure 22b. the tangent to the curve p has a 
constant direction for every z_ That Is, for each t, the crow-sections p of I in n' are a« 
solutions of the lame equation 

TdWdr - J[^) (1) 

where/ is some function of the viewing angle 4 and is independent of z. Let R(t) be a 



solution [o (1). Then the eross-SNtion function p of E has the fpim 

tffc ij - Atz).H(t) (2) 

where A d& a positive real function of %, Finally, r is twin continuously differentiate, by RL 
Hence A is a twice canting. Misty differentiate function of i, and SO is J? of 0. This complete* 

the proof of theorem L. 

Corollary 1; J, - (j a t tf and it J. 

Corollary 2; The crois-section p tan change at the pole* where A - 0. 

TJwkpi 2, A necessary and sufficient condition for I to satisfy Rl, and 
R2- R4 for all distant viewing positions, is that I be a quadratic surface. 

^roe/- If J is a quadratic surface, it satisf in RI ■ rt* Thii follows from the following three 

Observation!: 

(1) A sphere trivially satisfies Rl - R4 

(ii) Any linear transformation or translation presses Rl - R4 

Ciii} Any quadratic surface may be derived from a sphere by a linear transformation and a 

translation. 

Conversely, suppose that I satisfies Rl - R1 for all viewing angles Since the 
condition* of theorem I hold for every viewing ingle, I may be thought of as a generalized 
cone with generating crass-sections in, any direction. Hence, my two parallel planes intersect 
X in curvu that, if not null have the same shape. Suppoie that "2 ii the surface represented 
by the polynomial./^ > r z) - 0. Then a set of such parallel planes Is given by the family 
* - ax ♦ by * c k for varying c We deduce that the curves 



ftx r y, ax * by * C j ; _ rj 
fix, y r ax* by* cjj ■ 

are identical, up to magnificat urn and a ?ranila:tan. Hence the C t cannot multiply terms of 
second nr higher order. Therefore, Ln the original Equation, i Cannot multiply terms of 
second or higher order. Since the condition holds Tor arbitrary plane?, it mutt also be true 
of k and of y t and It must hold identically. Hence fn at must quadratic, and we have 
already seen that quadratic surface* satisfy the conditions of the theorem. 

Atmarks about the proofs of thtwmi } and 1 

The premise* of these theorems, and the way the premise* are used in the proofs, 
seem generally reasonable with one possible exception. That ii the use of A2 to show that 
2 n n ; is conves in lemma 2. In fact, this is how R2 forces the cross-section of I to be 
convex, which is a condition that held* all through these result. One might argue that this 
is a somewhat artificial use of R2, which was introduced mainly to exclude surfaces that 
contain lines. The analysis given so far concerns only the silhouette of the image of I 
however, and in these circumstances the convexity assumption for p is a reasonable one, 
because violations cannot bf detected from Viewing direction* that he parallel to the plane 
of fa. In practise, on* can apply the above analysis io all occluding contours in an image, 
provided that one subsequently relate! the different cylinder descriptions that emerge far 
different parts of the same surface. Figure & shows a simple example of this. 

Thtvttm 3 {AzlQi Symmtlryi, Let I - p X A he 4 generalized cone with 



Mm vex tKisi-McLton fi, viewed distantly from its associated Viewing plane 
IL and let the cress-section waling function Mi) contain at least one 
concavity. Then 

(i) the silhouette of £ decomposes into -a > 2 contour Stijmcnts by splitting it 
at points of inflexion: 

(iij the image or the axis A of E e«at>listiea an axial symmetry between at 
least 2 or (n ■ 2) (whichever is greater) contour segments. Including: all 
concave segments, mch that segments that correspond under the symmetry 
arc either both conves or both Concave; 

(ill) if cjj and c i2 are corresponding segments, and if rff Cj ) denotes the 
average perpendicular distant* from t t re the image of the axis, then 
dfcjj^fcjjj is independent of i. 
Proof; Since E is a generaiiwd cane and p is conves;, the contour generators for its image 
are the corves (Mi).p(8i) r t[, 2) and iM^.p(S 2 l » 2 - lJ r ° r fiKBd *l and s £ arid v * Fjable *< 
as shown in figure 1. Hence as AfzJ increases, the distance from ton tour generator to the 
image A* of the axis A increases on both sides of A*- Hence if h{z) has a concave portion, 
it will generate two concave segments. Cj and e £ -in C&, one either side of A* and symmetrical 
about A* (with a possible lawral displacement unless I is a right generalized cone). Also, 
dfeiJ/dftjJ depends upon the value of pMjJ/rfJgJ, and not on the particular choice of 
contour segment (i.e. of z), 

These remarks hold for all convex and concav* segment* of ft, except possibly for those 
at each end of I (»e figure 7). In figure 7, there is effectively only one end segment. 



namely cj> but in general there mar be 2. Hena the symmetry established by the a* is A* 
held* for at iHtt (A - 2) Of C^s contour segments, (or I of [hem if n - JJ, and it marches. 

up all contour segments that are concave, sLnce the end segments mu*t be convex. Finally, 
there must be at lean three contour segment!, since the premises of the theorem require that 
there be 2 concave ones, and C^ n a simple closed curve. 

Definition, The type of symmetry established by theorem 3^ which hold* 
between convex or concave segments of a contour and which includes a 
scaling f actor h we JhalJ call a yualttativt symmetry. 

Deflnmax. The set T of puna M^(t> for ill S ind each value of z t that 

rnak« i(z t ) a local maximum or minimum, is called the radial txirmlty of 
1. Let V be an arbitrary distant vantage point, and let yf be trie- p-nji>rciun 
from V onto a crou-iection plane Of E. as described in the main tent and 
illustrated Jn figure 9. The ss lV u T is called the thtittm of 2 for the 

vantage point V, 

Thtwtm 4 (SktUtsn Thinrem). Ut !>( u T be the skeleton of I associated 
with, some distant vantage point V, Then provided that Q v is the projection 
Of I>/ to P p 

to Cj/ ii qualitatively symmetric about the image of the axis A of E, in the 
senie Of theorem 3 



00 the image of T consists of one or more connected components, through 
which A passes, and between, any mo of which there exists a mapping that 
i£ (7 - JJ, continuous and onto, that preserves the gradient of (he image of T 
at each point. 
Proof: Ty* correpondi to a viewing direction that it eoplanar with the cron-section p, Hence 
the contours Cy{ in the imif? a; seen from V' obey the conditions oF theorem 3 r and the 
image of the axis A induces a qualitative symmetry between its concave and cqhvex 
components. Such relations are preserved by an orthogonal projection, and since ic is a 
condition of the theorem that Cy coincides with the projection of Tyf, it follow* that Cy ii 
also qualitatively symmetric about the image of A- Secondly, t trivially cortsaso of on* or 
more connected components through which A paSMS, Since these component* are just CTOU- 
sectionj it the local maxima and minima of k. Finally, if ATjij) and j\U 2 $ ar * ioaX minima 
Or minima of A t the mapping' between points on £ given by 

ii continuous, {1 - 1}, onto, and preserves the gradient of T at each point since the gradient 
of both at is p4fltt!&. This eorrtspnnd*noe is preserved by an orthogonal projection, and 

hence the relations will still hold in the image of T. 

Deflnitipji, Let E be a general Lied cone, and let d> be the set of points 
{h{z).p($ x } r & v z} for all z, for each $ t that makes p a local maximum or 
minimum. Then d) ij called the fluting of 2L For a viewpoint V, let IV' u 
T be the skeleton of S that occurs in theorem -L We define the emplttt 



sktitton by addmg the fluting io Tt skeleton, i.e, the complete skeleton of X 
from viewpoint V is the sec Ty f ufv^, 

TAtftrem J, Let Ty* u T u t be the «mplcte skeleton- or X itsociated with 
MiTiE distant vantage point V. Then 
(1} Cy arid the image of T obey theorem i 

(li) The image of e*ch portion pfij.pfty, % *h for fined $ L and varying 
ij of the fluting of 2 ii either a. straight line, or ic divides into convex and 
concave segment! that are in f J - /J correspondence with the convexities and 
concavities in thac pan of Cy which lies on the iame side oF it* axis of 
symmetry. 
Prwf; Part (i) follows from theorem 1 Fart (il) follows because like the iw© qualitatively 
symmetric components of Cp, each contour in the fluting of 2 is generated by variations in 
h(zl If such a contour lies directly on the line of Ughr to the axis A of I. it will appear in 
the image as. a straight line. Otherwise, lis concavities and convexities will folio* those of 
□ne component of Cp, although the depth of the concavities or convexities will differ in 
general, 

frfflTtftion, For i>|,2 let Ij be a generalized cone with ma-Kimum width 
2m i and axis A; of length l t . Let ^ and S 3 be joined, and lei u be the 
angle between their ax« (see figures it and 2 J). Then the join beiween Ine 
comes will be called lidftp-trid (the side of X[ to cbe end of E?) provided 



thai 

(i) the two axes intersect between the ends of At 

<ll) the whole of [he joined end A& of Eg ties between the two Ymtt 

perpendicular to and passing though Che ends of A| 

(iii) one oF the point! A and B of figure L4 cioei not lie within the convex 

hull of £|. 

The join is called ruftHnd if 

(I) the two nearest ends of Aj and Ag i" wiLhin mln (n/j, orgj of one 

another, and 

00 the 1 two f urfheit ends art greaier than fun * w ?) apart. 



TA*creB? £, Let E], and Eg be two convex generalised cones such thac the 
end or Eg joins the side of Ej- and the join satisfies restriction RS. Let the 
lengths of the conei 1 axes A ( he J |F and let the diameter* of their cross- 
tectioni he bounded by 2tst^ (i* 1, 2). Then 

(I) the only concavities that tan occur in the image are due to the junction 

(II) viewed distantly perpendicular to the plane of A; and Aj, the total 
concave angle present in the image U near 1SQ° {m the seme made precise 
in the proof) provided that the site of the jom is not near an end of Ei. 
and that S^ and Eg are much longer than the/ are wide 

Pump &7 lemma &. all contours derived .separately from I, and Eg are convex. Hence any 
cqnavity in the image of their union must be due 10 the wajr they are joined. If Ej_ and Eg 




23- Diagram for th* praof of [hcorerti 6, The idea is m cibtain lower bounds, for the 
concavities in the outline that are due to [hi join. The total concavity H (e * a'), which is 
near ISO . 



have coplanar axes and an? Viewed perpendicularly to this plane, (he reiulllng Configuration 
Is it represented in fig ure 23. The centaurs shown in thick ana there represent cylinder* i t 
tang and uij thick which, by the conditions of the theorem, bound [he cones T t U - K 2). Let 
P Be one- of the two points at which contours due to 2 t and Eg Entenocc, and let PQ± and. 
PQ% be the tangents to Zj and E 2 at P. Let « he I be angle between the a sees A x and A 2 or 
r ( and E 2 , and let J>j and ^ be the angles that PQ t and f^ mafce with K\ and A 2 . Then 
the angle between PQ { and P^ i* * - W 1 * w - tV^* The corresponding angle at the 
other intersection W between contours of Z\ and Ejj Is a^ - f« ■ ^ > ^ 4 ), as illustrated in 
figure 23, Hence the total concavity due to the Join is a f a' - fJSO ■ ^ ■ ^ 2 - ^ 3 - ^^> L 
In order to establish a lower bound for the dotal concavity, we need to find upper bounds 
for the angles ^, (J - J to *}. and we can use the- convexity of Ei Mid E^ to do this. Since 
the scaling Function* of E[ and Ej are convex^ the maximum possible value of 4"* l* +2 
(shown Jn figure- 23), which is exactly tat'^ngHfig - w^»ff id>j, and approximately 
ft* - 'fa^^- The maximum possible value of i^| is 0j, which is approximately Xair'fuiMjJ 
(see figure 2Sk and similarly for f 3 and ^. These approximations hold provided that the 
conei are long relative to their widths, and dj it not near or Jj — i.e. the join is net near 
either end. of I,_ 

Theorems 7 and « were sated precisely in the text and their proofs, which are 
straightforward, are omitted, 



